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Control me f.h o d for maeh ^ a 20 ® Z 6 



TECHNICAL FIELD. 



35 



The invents relates to , Mthoa „ a syetsm £or controlll ^ 
industrial „a Clline so a . to per£orm oparaclonB for ^ 
from one piece to another or to pecking the items in 
contemners. In particuler. the system is concerned with pick 
end piece machines including industrial robots or manipulators. 

> 



BACKGROUND ART 

The invention r.letes to e system for extrecting e„ object out 
of a plurality of objects. The objects may be stetic or in a 
continuous production flow. With objects in this context should 
be understood both object, which ere identioel es well as 

ooject or groups of objects that- 

, oaeccs that are different in shape, colour 

softness end such. The objects are placed or may arrive into 
the working sphere ot , „ bot in layers of a ^ ^ ^ 

rotating plate or the like, enter a. continuous stream on a 
conveyor. A common task carried out by a machine of a such 

and place task, include picking up object, from a conveyor belt 
and Placing them on a shipping pallet or picking up objects and 

p acing them in a shippi n3 carton, a well known „ e ie t " 

in a v 9 * =h0e0lateS f ™ » °°»-V« belt, and placing them 
in a packing tray or a chocolate box. 

US 6. 401 93S , entitled Divert apparatus for conveyor system, 

sorting" "t^T * C0, ""*°* This is a 

including Pr ° CeS8lnS a bordered stream of item. 

egoist. ZZ B±OMl n?n - tlat " tiC1 "- **™ 

. «LM o r ° f a " 1CXeS thr ° Uah the By "«» * Producing 

.tream in a so-called .insulating process. There is 




ft 
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also means for mechanically increasing the spacing between the 
items and a gate for discharging articles from the stream. The 
known system is designed for one type of articles only. 
However, when changing the type of object or distribution of 
S object types included in production the apparatus has to be 
mechanically re-adjusted. 

SUMMARY OF THE INVENTION 

The present invention solves one or more of the above problems* 

* 

In a first aspect of the invention, a method is provided for 

■ 

controlling a machine to pick up an item from a first position 
and place the item in a second position, wherein a sensor 
member provides data on said first position to a control member 
arranged for: sending a message from a master process of the 
15 control member comprising one or more said first positions to 
all said machines controlled by said control member; sending a 
message from aaid control member to all said machines with an 
indicator member specifying which of the one or more said first 
positions shall be bandied; and receiving a message from a said 
machine with a status that the first position has been used. 



10 



20 



« - ■ 



In another aspect of the invention, a system is provided with a 
master control member and with a control member for operating a 
group of machines so as to carry out the methods of the 
25 invention and adaptively move objects from a first position to 
a second position, 

' * . ' 

The invention describes a new prooess function, which is used 
for dynamically sharing object positions between a plurality of 
30 machines, preferably and not exclusively robots, manipulators, 

. * 

or pick and place machines, in order "to complete a task. The 
positions may be of individual objects, objects organized in 
patterns or free object positions, i.e. positions where objects 
shall be placed. The objects may be the same, similar or 
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different . The position, can be pieced on conveyors or'W^e'J 
other object frame - fixed or moving. *\ 

!!_ a !!! h ' r " rtbodln - nt - th ° invention describes a new solution 

of such positions among a plurality 
~ — ■ x n a rurcner and advantageous embodiment, load 
balancing is carried out among the robots handling the 
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15 



in another aspect of the invention a computer program is 
described for carryin B out the method according to the 

invention . In a„ other aspecc „ f lnvenclon , 

program product comprising a computer program for carrying out 
the method of the invention is described. 



In another, further 
signal embodied in a 
invention. 



of the invention a computer data 
wave is described according to the 
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L«faeeTI '"^ "* a ^icai user 

interface ia described eccording to the invention. 

< 

The principal advantage of the invention is that the objects 

pr r o e cl ndled ; ffi : ien " y * » «* or robots, The 

process x, adaptive and ensues that that one and only one of 
the robots handle each position. The order in which the 
poextxons are handled is independent of which individual robot 
or machxne >. handling the position. The positions can be 

Pieced on conveyors or any other object frame - fixed or 
moving. ~ 



: another advantage of the methods described in the invention is 

! » instan to taraB 0t -chine stoppages in 

an installation, since an . , 

Bince a11 machines always receive all 
35 positions and only successful 

y successful positxons are reported back from 
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the active machines. A machine or robot, which is no longeW*** 
running or is switched off, etc., cannot report a successful ^ 
operation, 

• * 

5 A further advantage is that load balancing may, if required, 
also be carried out which may be used to distribute the tasks 
evenly between machines in a production group or work group. 
This has the advantage of spreading the wear on machines evenly 
and of providing a degree of redundancy by balancing load 
10 levels below the maximum capacities of che machines. This also 
provides a simple and economic method to balance loads for 
downstream operations. 

* 

The methods and systems of the invention are especially 
15 advantageous in respect of flexible manufacturing. This is 

because changes in type or extent of production handled may be 
adjusted for primarily by re-configuring or re-programming , 
thus without the elaborate or expensive mechanical or 
electrical alterations to equipment and/or layout generally 
20 required by some devices of the prior art. The benefits of the 
invention are also not limited to new machines or installations 
but may also beneficially be retro-fitted to existing 
installations. 



30 



25 BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete understanding of the method and system of the 

* 

present invention may be had by reference to the following 
detailed description when taken in conjunction with the 
accompanying drawings wherein: 



Figure 1 shows in a schematic diagranT an adaptive filling 
procedure for stationary containers of a system for moving 
items from a first position to a second position according to 
an embodiment of the invention; 
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■ 

Figure 2 shows in a schematic diagram an adaptive filling ^Nfe 
procedure for moving containers of a system for moving items 
from a first position to a second position according to a 
further embodiment of the invencion; 

S 

* 

■ - 

Figure 3 shows a schematic block diagram for a master control 
process and a plurality of machine controllers in a system 
according to an embodiment of the invention; 

t 

t 

10 Figure 4 shows in a schematic diagram a load balancing 
operation for an adaptive filling procedure of moving 
containers according to a further and advantageous embodiment 
of the invention ; 

15 Figure 5 shows a flowchart for the process carried out by the 

master controller and the plurality of machine controllers of a 
system; 



Figure 6 shows a flowchart for a computer program to carry out 
a method for controlling a system for moving items from a first 
to a second position according to an embodiment of the 
invention; 

■ 

* 

Figure 7 shows a flowchart for a computer program to carry out 
25 a method in which a form of load balancing may take place, 
according to the further advantageous embodiment of the 
invention; 



Figure 8 shows a flowchart for a computer program to carry out 
a method for another form of balancing a load between a 
plurality of machines in a system according to an embodiment of 
the invention. 

Figure 9 shows schematically a method to select and/or sort 
35 objects for handling from a flow of moving objects. 



26/06/03 14:22 ABB AB PATENT 46 21 1811*36 * PAT.UERK ANSOKA NR. 741^ 

46 21 181386 ' 



V 



10 



JL3 



20 



25 



< » — 



30 



Figures 10-13 show schematically screen captures of parts of a 
graphical user interface of a system for carrying out an 
adaptive procedure for moving items from a first position to a 
second position according to an embodiment of the invention. 



■ * • 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

■ 

Figure 1 shows two sensors 7/8 and a first area comprised by a 
conveyor belt 5 . Three machines (not shown) each have a work 
area in a working sphere indicated by the circles 10, 11, 12. A 
series of items such the single item indicated as 2 are placed 
on the conveyor belt 5 . When an item is first registered by a 
sensor 7 or 8 this called a first position 3 of the item. The 
first position 3 is identified and communicated to a control 
system (not shown). Subsequently the items 2,3 are each 
transferred by one of the machines 10 or 11 or 12 into a second 
position, which in this example is a one of a plurality of 
containers, 4a or 4b or 4c or 4d. The conveyor belt 5 moves 
items into the working areas A10, All, A12 of the pick and 
Place machines from left to right as indicated by the arrow in 
the figure. However, the items could just as well be placed or 
dropped on the belt when stationery periodically without moving 
the conveyor belt in order to carry out a static 'filling in the 
adaptive way described. For example, in a batch operation, full 
containers may be removed from the machines working area as 
indicated for container 4D and empty containers placed in the 
working area as per container 14. In this description the 
machines described may. be any of manipulators, robots, robots 
of the Flex Picker (TM) type supplied by ABB, pick and place 
machines or equivalent . The group of machines working together 
is called a work group or. as the work group is adaptively 
carrying out work, an adaptive task completion group. Ate. 

Figure 2 shows in a second embodiment a dynamic adaptive 
filling where at least one conveyor belt is moving, and where 
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two or more transport members such as conveyor belts may be ^ 
involved, a first conveyor 5 is arranged moving past the 
working areas A10, All. A12 of three machines 10, 11, 12 (not 
shown) . items 2 on a moving conveyor 5 are sensed by a sensor 7 
5 or 8 when they enter a first position 3 . Any one of the 

machines 10, 11, i2 may pick up the item 2, 3 etc and place it 
in a second position which is in one of the containers 4a, 4b, 
4c or 4d. once a master process 40 (described in detail below) 
has instructed the machines by means of the list that the first 
10 position (s) exist. 
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In a further embodiment, a second conveyor 6 moves the 

containers 4a-4d away from the working areas A10-A12 of the 

machines, it can be seen from the figure that the containers 

4a-d are each progressively filled in an adaptive way by more 

than one machine as they travel past all working areas 10, 11, 

12. At the point where the container leaves, in this example, 

the working area of machine 12, the container (4d) has been 
completely 



Figure 3 shows in a block diagram a schematic representation of 
the system for controlling a plurality of machines. A Master 
process 40 is shown, which is connected by a network member 16 
to the controllers of a plurality of machines 10-n. The master 
process 40 may run as a part of one or more computer programs 
comprising a control system or run as a separate application 
with data connections to the control system. Each machine 
controller 41a,b,c comprises a list of all first positions, 
marked either to be handled or marked as consumed. In the case 
of a process that also includes load" balancing, each position 
xn the list is marked with an additional indicator identifying 
which of the machines, in this example, which of 10, 11, or 12, 
shall handle any given first, position. 
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The system for controlling a plurality of pick and place 
machines 10-12 has the following elements: 

a computer, whioh is connected to all machine controllers, has 

■ ■ 

a process, which is called the Master process 40, The first 
positions 3 (see Fig 1-3) are registered in one position on the 
conveyor 5 ahead of the first machine 10 in conveyor direction. 

■ 

Each first position registered by the system is given a unique 
identity. The Master process 40 keeps a list of all first 
positions. The first positions are marked with a status. The 
status shows whether a machine has consumed the first position 
or not. 

■ ■ 

Each machine controller 41a, 41b, 41c keeps a list of its own. 
The first positions in the list in each machine controller 
contain a status. The Master process 40 or the machine 
controller (41a or 41b or 41c) can change the status. 
The process is achieved by the following means: 
-the Master sends all first positions to all machine 
controllers ; 

-the Master marks the positions sent to the machine controllers 
with a status telling if they shall be used; 
-the machine controller, when a machine has used (handled) a 

» 

first position, then marks the corresponding position as used 
(consumed) and sends a message to che Master; 

-the Master marks the corresponding position in the master list 
as used and sends a message to all machine controllers saying 
that the position has been used; 

-each machine that receives the "Position Used" message then 
marks the corresponding positions in the copy of the list held 
by the machine or robot as used. 

None of the machines therefore will attempt to handle the 
position, or use the position, again. 

The advantage with the process described in the invention is 
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that it is robust by means of individual machine stoppages 
an installation, since all machines always receive all 
positions and only successful positions are reported back from 
the active machines. A machine or robot, which is no longer 
running or is switched off , etc cannot incorrectly report a 



An additional development of the invention is the possible 
inclusion of a synchronisation method. By triggering the first 
positions more than one time, the accuracy of the already 
registered first position can be corrected, if necessary, and 
the precision increased. This may be achieved either through 
use of a global trigger for all robots, such as a time stamp, 
to which all robots synchronised to. This covers for possible 
changes in the environment, slack in the conveyor belt, an 
object removed from a work area by an inspector or client, and 
gives a second check on the position and/or more accuracy in 
the registration of the first position. In a further 
development a second trigger may be arranged beside each 
machine. When very high precision is required a second sensor 
or camera may be included beside every machine for great 
accuracy of location of the first positions. 



« 

Figure 5. shows in a flowchart a process of the invention for 

« 

controlling a plurality of machines. The List updating begins 
at step 51 with registering a new first position that a sensor, 
7 or 8, has detected and measured the position of. At 53 a 

- 

unique identifier, which may be a number, alpha-numeric string, 
a code or at least one symbol, is allocated to the new first 
position (such as indicated item 3 in, figs 1-3) . At 5S a marker 
is added to the first position to show whether it has been 
handled by a machine - used, consumed- or not. At 57 an 
indicator is added to identify which individual machine of the 
whole group controlled shall handle the new first position. At 
59 the updated list of all first positions, wherein all used 
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positions are so marked, may be sent to all the machines in the 
group . 



Figure 6 shows a flowchart for a method to control the machines 
5 according to a preferred embodiment of the invention . In step 

« * 

61 the master process 40 (see fig 3), which may be a process 
running in a processor or computer, marks the positions in a 
list of all positions with a status indicating if those 
positions are to be handled (used). In step 62, the master 

10 control process 40 sends the current list of all first 

positions to all the controllers 41a, 41b, 4c...41n of all 
machines 10, 11, 12, , ,.n in the work group as a first step 61. 

When a machine 10, 11, 12, n or robot has handled the 

position, it marks its own copy of the list as position used in 

15 step 64. Tne machine controller of the handling machine then 
sends a message to the master control process 40 in step 65 
reporting that the position is handled, used. The master 
control process 40 updates its list to show that the position 
has been used, then sends a message to all machines indicating 

20 that the respective first position in step 66 now has the 

ptatus of used. Each machine or more particularly, each machine 
controller, then updates its own copy of the positions list to 
show that the respective position has been used. 



25 Figure 4 illustrates one example of how a load balancing can be 
carried out according to another aspect of the invention. A 
load comprising a flow of items 2 delivered on a transport 

* ■ 

\ conveyor 5 flows past working areas A10-A12 of three pick and 

: place machines (not shown) . Three other transport conveyors 

;30 26a, 26b, 26c move the items to another destination. Items 2 

: are identified in a first position 3 by a camera or other 

■ • 

sensor 7 . The first position 3 is identified and communicated 
: to a control system {not shown) . The control system calculates 
a balanced load to each of the three out conveyors 26a-c and 
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instructs: which of the items shall be picked up and placed in 
a second position on one of the three out belts 26a-c; and, by 
which of the machines 10, 11, 12 (not shown). As items are 
picked up from a first position on belt 5 and placed in a 
second position on one of the belts 26a-c each of the belts 
26a-c receives a similar and balanced load of items 2,3- 

• » ■ 

• 4 

# 

f 

Figure 7 shows a flowchart for the method of Figure 6 with the 
addition of an option for a form of load balancing process. At 
72 the process in the master control process 40 checks if load 
balancing is to be carried out on the present objects/ first 
positions. A Yes decision results in the Master indicating for 
each first position in the list, which of the machines eg 10, 
11, 12 shall handle each first position. In step 73 the lists 
thus marked are sent out ctnu steps 76-78 are as before = A No 
decision results in the list being sent out to all machines in 
step 74 and steps 75-78 are as before 64-68 in fig 6. 

* » 

Figure 8 shows a flowchart for another further optional load 
balancing process. The load balancing for all machines in the 
group starts at 81 when the sum of all non-consumed (unhandled) 
first positions is calculated by a computer process for each 
machine or pick and place robot. At 83 the total non-consumed 
(unhandled) first positions (ncfp) per machine is compared. An 
algorithm may be used for this purpose. At 85, one or more of 
the non-consumed (unhandled) first positions are chosen to be 
re-allocated, which may be done by means of an algorithm. At 87 
the chosen non-consumed first position is found in the list of 
all first positions (fig 3) and the machine indicator is 
changed, 

* 

If so required, sorting of the objects may optionally be 
carried out for a selection of objects in a oontinuous 
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production flow according to given sorting rules, A continuous 
production flow, which feeds objects into a robot working area 
is defined by the positive flow direction, hereafter named *X W 
and its perpendicular direction in the horizontal plane of a 
5 right-hand coordinate system, named W Y" • 



• m 



4 » 
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For example in a task to load objects into positions in X, Y 
and Z axis positions the robots each pick up and place the 
objects that they have time to pick up. As objects are placed 
10 in front of robots, or objects flow past robots on a conveyor 
belt a pallet or box or other container is incrementally 
loaded. 



Figure 9 shows a method for sorting or selecting objects to be 
15 handled* In this embodiment a moving transport member, such as 

» * 
» 

a conveyor belt moves objects past the machines is described, 
but a static adaptive fill, in which objects are periodically 
placed in front of the machines, may use the same algorithm 
somewhat modified. Figure 8 shows a conveyor belt 91, a 
20 plurality of objects including objects 90-99, and two reference 
positions relative to the belt 91, being an Enter point 100 and 
a check limit 101. An exit position 102 is also marked. The 
direction of flow of the objects is indicated by arrow X and 
the sort direction, the direction the machines pick and move 

« 

25 the objects to, is in the direction or arrow Y. 



Information about all objects, such as position, orientation, 
type and size, are stored in a buffer in an industrial machine 
controller, some of which is supplied by sensor 7 or sensors 7 
.•r,30 and 8. A new object is requested from the buffer when the 

machine or robot is about to use the~*object as a target, that 
is, when it becomes a first position. The robot operation can 
only be performed when the first position is within the entry 
and the exit limit of the X-direction. The machine controller 
35 (4la, 4ib, 41c) of each machine (10, 11, 12 ) or robot 
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supervises this. Within this work area, it shall be possible to 
choose the object with respect to the priority rules in X- and 
Y- or/and 2-direction. 

» 

5 Preferred information for sorting: 
Sort direction: 

From which direction the sorting will be done. Given in object 
request command; 



10 The clearance area for sorting. Given in object request 
command; 
Enter limit: 

The limit where the machine can start operate on an object. 
Given when defining a new object buffer; 
15 Exit 

The limit where the robot can't operate on an object. The 
objects will be erased from the buffer when they enter this 
limit. Given when defining a new object buffer; 
Check limit: 

20 Optional limit where the robot can't operate on the object. The 
objects will not be erased from the buffer when they enter 
this. Given in object request command: 

The sorting algorithm chooses the first position, which is the 

25 position of the object closest to the exit limit in X-direction 

and depending on the non-presence of other objects in direction 

of the sorting, the first first position in the sort direction 

will be selected. A safety distance defines the required 

clearance area around an object. The algorithm will check both 

30 upwards and downwards the production flow for presence of other 
iects. 



When a new object is requested from the object buffer, the sort 
direction and safety distance is given as parameters in the. 



14:22 ABB flB PATENT 46 21 181US6 •> PAT . UERK ANS5KA NR?^<^^ 

46 21 181386 %~ 

request command. The sorting algorithm will then choose which ^ 
object the robot shall operate with. 

By using a check limit, in. the x-direction, as a parameter to 
the request command, it ip possible to define the starting 
point from where the first object shall be extracted. The 
command will try to extract the first object between the check- 
and enter limit. This will have the effect that the sorting 
algorithm also takes all objects between the check limit and 
the exit limit into consideration when checking the safety 
distance for the nearest objects. By this inventive algorithm 
the objects can be extracted from the flow without touching 
surrounding objects. The objects can be shuffled sideways 
without any risk of bumping into other objects in the 
production flow. 

* 

It is possible to combine the directional sorting with type 
request. The first object of a certain type in the production 
flow will then be selected according to previous described 
algorithm. 



Normally the production flow is in the horizontal plane. 

« 

However there is no limitation to what direction the production 
flows. As an example the production flow. can be vertical. This 
situation arises when the products arrive into the operation 
area on a pallet where the articles are piled individually ox 
in layers. The detection information is then achieved from 
package pattern or by having the pallet moved between the 
detecting area and the operation area. 

The sensor or sensors 7 , 8 may be any suitable sensor. The 
sensor may be non-optical such as a magnetic, ultrasound, 
pressure or force transducer. An optical sensor may be any 
suitable optical sensor such as a photocell, an IR sensor, a 
video or CCD camera. A sensor may also comprise or be in some 



15 
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way connected to a computer application for processing signals 
or processing images to detect the presence of objects as 
required . 

* 

5 The methods described above may be carried out by means of one 

• ■ 

or more computer programs . In particular, the Maseer control 
process 40 comprising steps 61-68 of Figure 6 may run in one or 
more computers or processors (not shown) . which may be located 
in the proximity of the machines, robots or pick and place 
10 machines, or may otherwise be located remotely. The 

microprocessor (or processors) comprises a central processing 
unit CPU performing the steps of the method according to one or 
more aspects of the invention. This is performed with the aid 
of one or more computer programs, which are stored at least in 
part in memory accessible by the one or more processors. It is 
to be understood that the computer programs may also be run on 
one or more general purpose industrial microprocessors or 
computers instead of one or more specially adapted computers or 
processors . 

20 

The machine controllers 41a, 41b, 41c, comprise at least a 
memory member in which the individual machine copy of the list 
of all first positions is stored and updated. The controller 
may also comprise a processor of some sort for processing 
instructions for machine control such as of a computer program. 

* 

4 

The computer program of the Master control process 40 and of 
the processes in the machine controllers 41a, 41b, 41c, both 
comprise a type of computer program code element or software 
code portion that make the computer or processor perform the 
method using equations, algorithms, data, lists and 
calculations previously described. A part of the program may be 
stored in a processor as above, but also in a ROM. RAM, PROM or 
EPROM chip or similar memory means. The program in part or in 
whole may also be stored on. or in, other suitable computer 
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readable medium such as a magnetic disk, CD-ROM or DVD disk/ 
hard disk, magneto-optical memory storage means, in volatile 
memory, in flash memory, as firmware, or stored on a data 
server. Other known and suitable media, including removable 
5 memory media such as Sony memory stick and other removable 

■ 

■ 

flash memories, hard drives etc. may also be used. 

* * 

r 

The computer programs described may also be arranged in part as 
a distributed application capable of running on several 
different computers or computer systems at more or less the 
same time . 



The control signals from the Master process 40 comprising 
instructions to the pick and place machine controllers 41a-c 
15 maybe transmitted over a LAN or other data network 

communication member to a standard such as any of: half or full 
duplex TCP/IP, Ethernet, a fieldbus, Profibue, Modbus, (CAN), 
Foundation Fieldbus (ff> or similar. The data network may be 
wireless at least in part, such as a WLAN, or using short range 
radio such as according to standards such as Bluetooth or the 
wireless Ethernet standard IEEE 802.11b, wireless ATM 
(Asynchronous Transfer Mode) network standard IEEE 802.11a or a 
standard according to HomeRF or any similar standard that may 
be used in industry. The signals may also be transmitted from a 
25 remote place and comprised in a computer data signal embodied 

* 

on a carrier wave. The computer data signal may be transmitted 
in part to or from a portable computing device such as a 
laptop, a PDA, a suitably equipped mobile phone, or a 
controller or a Teach Pendant by any suitable wireless standard 
30 including IR and radio. The information in the computer data 
signal may be displayed in part by a "graphical user interface 
of any of the portable computing devices named above or by a 
portable terminal. The computer program of the Master process 
and of the processes in the machine controllers may also be 
35 provided over any data network including the internet . 
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A Graphical User Interface (QUI) may be used to operate or 
control the methods of the certain embodiments of the 
invention. Figures 10-13 show some exerrgplary graphic user 
interfaces. Figure 10 shows how adaptive work groups, AtcGroup 
108 and AtcQroup2 109 may be formed and configured. A new 
AtcGroup 106 or new WorkArea 107 may be dragged from the area 
right of interface and dropped in a position on the left of the 
interface and so representing in which AtcGroup a WorkArea 
belongs * By using the term "drag and drop" it is only intended 
as one example of a method of manipulation of a representation 
of a software object that represents a technical object that is 
either conceptual, or a real world object, in order to control 

■ » 

or perform an operation. 



15 



20 



25 



'30 



Figure 11, Distribution interface, is visible when, for 
example, a tab 115 has been selected. The distributors 
available for configuring, such as load balancing groups 
LbGroups 112, 113, 114 are shown, as are two AtcGroups shown 
116a, 116b, and three WorkAreas shown numbered 107 according to 



Figure 10. Each WorkArea once configured, 110, 111, is a 
software representation of a work area of a machine or robot, 
(10, 11, 12 of Figures 1-4). These objects may be configured 

i 

into Distributions arranged according to the product or item 
handled by dragging and dropping, to form an item distribution 
such. as the two shown in the left side of the interface. Item 
distribution Iteml, here numbered as 118, is shown to include 
one AtcGroup, 108, and three work areas shown here as 108a , 
108b, 108c; a Reject function with a bypass element is also 
shown . 



Item distribution Item2 is shown indicated by number 119, and 
Item2 includes an example of a load balancing group LbGroup 
132, in which the work is to be balanced 33%-67% between work 
areas 111, i e WorkArea 1 and WorkArea3 in this 



'35 
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Figure 12 shows the Order interface selected, for example, by 
means of a tab 121 which provides a method for a user to 
determine an order in which the objects reach (the work area 
of) each machine or robot 10, 11, 12 to be thus picked up and 
placed. Thus configurable objects in the right side of the 
interface are three work areas 107i C available to work from a 
conveyor, InConveyor; and another type of work area called 
IndexedWorkArea 3 , shown as 107 ' . On the left side of the 
interface the order in which the objects will make contact with 
the work areas {and the machines in them) are shown as 110 and 

4 m ( 

in the order WorkAreal, WprkArea2 , and WorkArea3 are shown in 
number order. Further objects may be dragged and dropped from 
the right to the left side (or deleted by the reverse action). 
The order of work areas on the left may be switched by dragging 
and dropping on the left side. 



20 



25 



30 



* 



Figure 13 shows an interface for selecting one or more Load 
balancing functions according to a further and advantageous 
embodiment. The available distributor a on the right side which 
may be included in the configuration on the left side of the 
interface include first a new load balancing group. New LbGroup 
130, WorkAreas 107, AtcGroups 116a, 116b, and a Bypass 
function. The load balance groups shown configured in the left 
part of the interface include three load balancing groups, 

» 

LbGroup 132, LbGroup2 133 and LbGroup3 134. LbGroup 132 
includes the three WorkAreas 110. The second load balancing 
group LbGroup2 shows two Bypass areas as well as three 
WorkAreas 110', which may or may not be the same as the 
previously used WorkAreas. The third load balancing group 
LbGroup 2 shows an Ate group and one WorkArea. 



It should be noted that while the above 
embodiments of the 

modifications which may be made to the disclosed solution 



exempl i f ying 
variations and 
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without departing from the scope of the present invention 
defined in the appended claims* 



CLAIMS 
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1. A method for controlling a machine (10, 11, 12) to pick up 
an item (2) from a first position (3) and place the item in a 
second position (4a. 4b, 4c), wherein a sensor member (7) 
provides data on said first position (3) to a control member 

» • 

(40), characterised by 

-sending a message (61) from a master process of the control 
member (40) comprising one or more said first positions to all 
said machines (10, 11 , 12) controlled by said control member, 
-sending a message (62) from said control member to all said 
machines (10, 11, 12) with an indicator member specifying which 
of the one or more said first positions (3) shall be used. 

* ■ 

a 

2. A method according to claim 1. characterised by 
-receiving a message (65) from a said machine (10, 11, 12) with 
a status that a said first position (3) has been used, 
-sending a message comprising the said first position (3) , or 

i 

more said first positions, to all machines (10, 11, 12) 
controlled by the control member (40) in which message each 
said first position is marked with a status of used or not- 

« 

3 . A method according to claim 1 or 2 , characterised by 
-receiving at a said machine (10, 11, 12) the message 
comprising one or more said first positions, 
-handling one of the one or more of said first positions, 
-sending a message to the control member (40) comprising the 

that a such said first position has been used. 



4. A method according to claim 1, characterised by 
-updating in said control member (40) the marker of the one 
said first position to read used, and 

* ' 

-sending from the control member (40) to all machines (10, 11, 
12) a message that the status of the said first position 
consumed is equal to used. 
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S. A method according to claim 1, characterised by a control 
member (40) selecting (73, 85) one or more specific said first 
positions to be handled by a specific machine (10, 11, 12), 



6. A method according to claim 5 f characterised in that the 

■ * 

control member (40) uses a algorithm to select a said first 

■ - 

position to be handled by one specific machine of all 
(10, 11, 12). 



7. A method according to claim 5, 
control member (40) carries out a 
first position. - 



characterised in that the 
repeated triggering of a 



8. A method according to claim 1, characterised by 
-registering said first position (3) of the item together with 
a unique identity meriber, 

-marking each said first position with a status of used or not, 

9. A method according to claim 8, characterised in that the 
unique identity member takes the form of a number. 

V 

10* A method according to claim 9, characterised in that the 
unique identity member takes the form of an alphanumeric 

* 

string. 

- ■ • 

11. A method according to claim 1, characterised by allocating 
a said first position to a specific machine dependent on load 
balancing for a plurality of machines (10, 11, 12) controlled 
by the control member (40). 



12 • A method according to claim 11, characterised by allocating 
a said first position to a specific machine dependent on load 
balancing for all of the machines controlled by the control 
member (40) . 
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13. A method according to claim 1, characterised by allocating 
a said first position to a specific machine dependent on a 
stoppage that has occurred in a work group controlled by the 

« 

control member (40) . 



14. A method according to claim l f characterised by allocating 
a said first position to a specific machine dependent on the 
removal from service of another specific machine in the work 
group controlled by the control member (40) . 

10 

> 

15. A system for controlling a machine to pick up an item from 
a first position and place the item in a second position, 
comprising a sensor member (7, 8) , a plurality of machine 
members (10, 11 , 12} to pick up an item (2) from a first 

15 position (3) and place it in a second position (4a, 4b, 4c) , 

and a control member (40) to control said plurality of machines 
(10, 11/ 12), characterised in that the control member (40) is 

» 4 

connected to at least one machine control member (41a, 41b, 
41c) for one of said plurality of machines (10. 11, 12), which 
20 control member (40) comprises a list of all said first 
positions. 

• * 

16. A system according to claim 15, characterised in that the 
control member (40) comprises computer program elements to 

25 change the status of a said first position on the list of all 
said first positions. 



17, A system according co claim 15, characterised in that each 
of the at least one machine controller members (41a, 41b # 41c) 

m + • 9 

A * 

30 connected to the control member coxttprises computer program 

elements to change the status of a said first position on its 
list of all said first positions. 

: IB, A system according to claim 17, characterised in that the 

• ■ 

at least one machine controller member (41a, 41b, 41c) 
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comprises computer program elements to update the status of a 
said first position on its list of all said first positions on 

* 

receipt of a message from the control member (40) . 

* i 

19. A system according to claim 18, characterised in that the 
at least one machine controller member (41a, 41b, 41c) 
comprises computer program elements to sena a message to the 

* * 

control member (40) when a said first position has been 
handled. 



20. A system according to claim 15, characterised in that each 
first position of all said first positions on the list are 
recorded together with a unique identifier member. 

21. A system according to claim 20, characterised by comprising 
a synchronisation member that provides a signal suitable for a 
any of the machines (10, 11, 12) to base a trigger action on. 

22. A system according to claim 15, characterised in that at 
least one said sensor member (7, 8) comprises a non-optical 



23. A system according to claim 15, characterised in that at 
least one said sensor member (7, 8) comprises a vision or 

■ 

optical detection member. 



24. A system according to claim 23, characterised in that the 
at least one said sensor member (7, 8) comprises a photocell. 

25. A system according to claim 23, characterised in that the 
at least one said sensor member (7. ST) comprises a camera and 
an image processing member. 
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26. A system according to claim 25, characterised in that the 
image processing member comprises computer program elements 
arranged for image recognition. 

* 

* ■ 

5 27 . A computer program comprising conqputer code means and/or 
software code portions for making a computer or processor 
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S. A method according to claim 1, characterised by a control ^^4^ 
member (40) selecting (73, 85) one or more specific said first 
positions to be handled by a specific machine {10, 11, 12), 

■ 

5 6. A method according to claim 5, characterised in that the 

* 

control member (40) uses a algorithm to select a said first 
position to be handled by one specific machine of all machines 
(10, 11, 12) . 




10 7: A method according to claim 5, characterised in that the 
control member (40) carries out a repeated triggering of a 
first position. 



8 • A method according to claim 1 , characterised by 

F 

15 -registering said first position (3) of the item together with 
a unique identity member, 

-marking each said first position with a status of used or not. 

9 . A method according to claim 8, characterised in that the 
20 unique identity member takes the form of a number. 

10. A method according to claim 9, characterised in that the 

unique identity member takes the form of an alphanumeric 

■ 

string. 



25 



11- A method according to claim 1, characterised by allocating 
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34. A computer data signal according to claim 29 , characterised 
in that said computer data signal is communicated by means of a 
short call-back procedure over an ordinary Public Switched 
Telephone Network (PSTN) , a wireless telephone system, a 

5 privately switched network, cellular network or satellite based 

*. ■ * 

telephone network. 



m ■ d 
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35. A graphical user interface for controlling a machine (10, 
11, 12) to pick up an item (2) from a first position (3) and 

4 

10 place the item in a second position (4a, 4b, 4c) by means of a 
method according to any of claims 1-14. 

■ • 

36. A graphical user interface according to claim 35/ 

■ 

characterised in that the GUI comprises software object 
15 representation members (10B, 109/ 110, 111) to configure any of 
a plurality of machines (10, 11, 12) as any from the list of: 
-a work group (108) for adaptive moving of objects (3) by the 
machines (10, 11, 12); 

-a Distribution (118, 119) of machines (10, 11, 12) arranged 
20 according to identity of object handled? 

-an Order in which the objects shall reach the machines (10, 
11, 12) expressed as WorkAreas (110, 111); 
-a load balancing group (132, 133, 134) in which loads are 
balanced among any of the machines (10, 11, 12) . 

25 

37. A graphical user interface according to claim 36, 
characterised in that configurations are arranged so as to be 
displayed and/or edited upon activation a part of the graphical 
representation of one or more production areas comprising one 

30 or more machines (10, 11, 12) by means of a computer mouse, a 
keyboard, a keypad, touch screen, stylus or any other similar 
computer display selection means. 

■ 

38. A graphical user interface according to any of claims 35- 
35 37, characterised in that one or more machines (10, 11, 12) may 
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be configured to pick up an object from a first position and ^A^ t 
place the object in a second position by means of carrying out 
a drag and drop operation on a software 
member (110, 111) . 



» » 



• * 
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ABSTRACT 

The invention describes a method for controlling a group of 
machines such as robots 10, 11, 12, or pick and place machines 

* 

to pick up an item from a first position and place the item in 
5 a second position, information from a sensor 7 about the 
location of the first position 3 is provided to a control 
member 40 which sends a message from a master process to all 
machines- The message comprises a list of all first positions . 
The machines dynamically and adaptively handle each of the 
10 first positions and inform the master process when each first 
position is handled* The master process in turn informs all 
machines that a given first position has been handled. A 
system, a computer program and a graphical user interface are 



15 (Figure 2} 



26/06/03 



14:22 



ABB AB PATENT 46 21 181^36 * PAT.UERK ANS8KA 

46 21 181386 



4f Jfft 



CO 



* 
* 



* 
♦ 




CO 



26/06/03 



14:22 ABB AB PATENT 46 21 1811*36 * PAT.UERK ftNSQKA 

46 21 181386 



NR. 741 




26/06/03 14:22 fiBB flB PATENT 46 21 181L436 ■» PfiT.VERK fiNSQKfi NR. 741 

46 21 181386 



CO 

cr5 



CO 



• * * 

* • » 



» - - - . 











CO 


g 


03 






o 













line 
troiie 




o c 




eg o 
% ° 





I 
I 

I 

I 



o 



CO 




CD 

c 








com 



7?r 





♦ 






CD 
C 


8 




Mach 


con 



CO 

5 



JOBS ^ , e 





p p 


ine 10 
[roller 




7^ 

O 

CD 
C 




CO o 

2 


• 


8 



26/86/03 



14:22 ftBB flB PATENT 46 21 181^36 * PAT.UERK RNSSKfi NR. 741 

46 21 181386 




14:22 



ABB RB POTENT 46 21 181 JQ6 •> PAT.UERK ANSSKA 

46 21 181386 

r 

5/13 



NR. 741 



51 



53 



ft 



55 



57 



Start List update 



Master registers a new 
first position on master list 



Add unique identifier number 
for the new first position 



Marker added marker to new 
first position when it is 
consumed 



On 
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Stop 
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Master marks each first position 
with a status if it is to be handled 



i — ; 

Master sends list of ail first 
positions to each machine 

co ntroller 

i 

A machine controller marks a 

first position after handling it 

The machine controller sends 
the marked first position to the 

Master 

l 

Master marks the first position in 
master list as used, sends message 
to all machine controllers that the first 
position has been used 

Each machine controller receiving 
message updates its own list to show 
the first position hasTaeen used 
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Start 

Adaptive task update 
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Master marks each first position 
with a status if it is to be handled 
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Master sends list of ail 
first positions marked 
per each machine 



Master sends list of all 



first positions to each 
machine controller 



A machine controller marks a 
first position after handling it 



I 



The machine controller sends the 
marked first position to the Master 



I 



Master marks the first position in master list as 
used, sends message to all machine controllers 
that the first position has been used 



I 



Each machine controller receiving 
message updates its own list to show 
the first position has been used 




Stop 
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Start 

Load balance update 
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Sum all non-consumed first 
positions for each machine 




* 
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* 



Compare each total ncfp per 

machine 



Identify one or more ncfp 
to be re-allocated 



«► - - 



send ncfp to List update 
loop as new fp 
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